ON THE COST OF DECIDING CONSENSUS 
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Abstract. We study the computational complexity of a general consensus problem for switched systems. A set of n X n 
stochastic matrices {Pi, . . . , Pk} is a consensus set if for every switching map r : N — >■ {1, . . . ,k} and for every initial state a;(0), 
the sequence of states defined by x(t + 1) = P^(^i-^x{t) converges to a state whose entries are all identical. We show in this paper 
that, unless P = NP, the problem of determining if a set of matrices is a consensus set cannot be decided in polynomial-time. 
As a consequence, unless P = NP, it is not possible to give efficiently checkable necessary and sufficient conditions for consensus. 
This provides a possible explanation for the absence of such conditions in the current literature on consensus. On the positive 
side, we provide a simple algorithm which checks whether {Pi, . . . , P^} is a consensus set in O (^Bk'n? + rfi^ operations 
where B is the number of bits needed to specify each entry of Pi , . . . , P^ . 
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1. Introduction. There has been much recent interest in the design of control pohcies for distributed 
systems of mobile agents. This has been motivated by the emergence of large scale networks without 
centralized control and with uncertain or time-varying connectivity. Controllers deployed in such systems 
ought to be completely decentralized, relying only on local information, and resilient to unexpected node 
and link failures. 

Consensus algorithms are a class of iterative update schemes which are commonly used as building 
blocks for the design of such controllers. They have recently been used in a variety of contexts, such as 
coverage control [1] , formation control [TTl [T^ , distributed estimation [T71 [15] , distributed task assignment 
[3], distributed optimization |14] and [S]. These algorithms provide a means by which distributed systems 
with limited or uncertain connectivity can reach a common state. They are often used as subroutines in 
various application areas. 

The problem of finding convenient conditions for the convergence of consensus algorithms is an active 
area of current research. Much of the present literature is focused on sufficient conditions for consensus 
algorithms to converge. Such conditions have become progressively more general with time; we refer the 
reader to [HI [5j 13 [II El [HI [7] for a sampling of the literature. However, despite the significant attention 
attracted by this problem, there is no known efficiently verifiable condition that is both necessary and 
sufficient for consensus. 

In this paper, we investigate the computational complexity of consensus algorithms of the following form: 
We are given a set of row-stochastic matrices Pi, . . . , Pk, an initial state a;(0) and we consider the sequence 
of states (a;(0), a;(l), . . .) resulting from 

X{t + 1) = Pr(t)X{t) t = 0,l,... 

for some switching map r:N— A set of matrices Pi, . . . , Pk is said to be a consensus set if 
such sequences always converge to a state whose entries are all identical. In other words, consensus requires 
lim4_^oo x{t) = al for all possible switching maps and initial state a;(0) (here 1 denotes the vector of all ones 
and a is some scalar which depends on a;(0) and on the switching map). As we will show in the next section, 
the consensus property is known to be equivalent to the condition that for every switching map t the limit 

lini P.r(t) ■ ■■Pr{2)Pr{l) 

t—^oo ^ ' ^ ' ^ ' 

exists and has rank one. 

The purpose of this paper is to investigate the computational complexity of deciding consensus. Before 
we state our main results, we illustrate with a small example that deciding consensus may be a non-trivial 
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Fig. 1.1: The graphs Gi and G2. The stochastic transition matrices corresponding to these two graphs do 
not form a consensus set. 
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Fig. 1.2: The graphs G'l and G2. The only difference with the graphs on the previous figure is the additional 
self-loop at node E. The stochastic transition matrices corresponding to these two graphs form a consensus 
set. 



task. Consider the two graphs of Figure 11.11 To a graph G we associate a stochastic matrix A by defining 
o-ij — ^/d{i) if ih j) is an edge in G, and aij — otherwise. Here d(i) is the number of neighbors of node i, 
where we count node i as its own neighbor if it has a self- loop. To the graphs of Figure [Ol we associate to 
the two stochastic matrices Ai,A2 and we claim that these do not form a consensus set. Indeed, it is easy 
to verify that the product A1A2 has the property that the rows corresponding to nodes A and E have only 
a single nonzero entry, namely a 1 on the diagonal . It therefore follows that the limit \imk{AiA2)'^ does not 
approach a rank-1 matrix and the matrices Ai and A2 do not form a consensus set. 

Consider now instead the stochastic transition matrices associated to the two graphs G[ and G2 of 
Figure 11.21 Note that the only difference with the graphs of Figure 11.11 is the additional self-loop at node 
E. This turns out to make a difference for consensus: a simple computation reveals that every product of 
length 4 of these two matrices has a column whose entries are strictly positive. It is well-known (and, in any 
case, follows out of the more general results we will show in Section 2) that this implies these two matrices 
form a consensus set. 

After this small motivating example, let us now briefly describe our results. 

In Section ^ we show that a set of matrices is a consensus set if and only if every product of length 2^" 
of matrices from the set has no two rows with disjoint support (n is the dimension of the matrices). This is 
a stronger version of a result of Wolfowitz [19j . Verifying if a matrix has rows with disjoint support is an 
easy computational task and so it immediately follows that consensus is algorithmically decidable. 

In Section [31 we turn our attention to the computational complexity of consenus and we show that, 
although decidable, the problem of deciding consensus is computationally hard. We first prove in Theorem 
I3.1l that. unless P = NP, the problem of determining if a given set of two stochastic matrices is a consensus 
set cannot be solved in polynomial-time. We then prove a similar result for undirected matrices. A matrix 



P is undirected (or sign pattern symmetric) if ptj ^ implies pji ^ 0. Undirected matrices are important 
for consensus problems because they often appear in applications where information exchange goes in both 
directions: whenever i communicates with J, j communicates with i (with possibly different strenghts). For 
example, suppose the iteration 

x{t + 1) = P{t)x{t) 

is implemented by a collection of vehicles seeking to perform some distributed control task. If the variables 
Xi(t) represent the positions of the vehicles, and if each vehicle will measure and take into account the 
positions of all neighbors with which it has line-of-sight communication, the resulting matrices P{t) will 
be undirected. More generally, undirected matrices are likely to appear whenever a consensus process is 
implemented in a system with symmetry in the sensing or information exchange process. In Theorem 13.21 
we prove that the problem of determining if a set is a consensus set cannot be decided in polynomial time 
(unless P ~ NP) even if we assume all matrices to be undirected. Our proof is for the case of three (or 
more) matrices. We believe that the same result holds true if there are only two undirected matrices but we 
haven't been able to derive the corresponding proof. 

As a consequence of these two results there cannot be a necessary and sufficient condition for consensus 
which is verifiable in polynomial-time (unless P = NP). This probably provides an explanation for the 
state of the current literature in which one can find several sufficient conditions as well as several necessary 
conditions for consensus, but no tractable conditions that are both necessary and sufficient. 

In Section [3J we make a final observation that if the matrices are symmetric (rather than sign pattern 
symmetric) , then the problem of consensus becomes decidable in polynomial time. 

The sections [5] and [3] and are not independent, as the proofs in Section |3] depend on certain lemmas in 
Section [2l We conclude our contribution with some remarks and open problems in Section |4l 

2. Decidability of the consensus problem. In this section we provide an algorithm for checking 
whether a set of matrices is a consensus set, thus proving that the consensus problem is decidable. The 
algorithm is based on a certain finitary condition for consensus. While consensus was initially defined in 
terms of infinite product of matrices. Theorem 12.21 below shows that a sets of matrices is a consensus sets if 
and only if all products of matrices from this set of length 2^" satisfy a certain easily-checkable property. 

We begin with a formal statement of our results. 

Definition 2.1. A (row) stochastic matrix is called scrambling if no two of its rows have disjoint 
supports. 

Theorem 2.2. The set of stochastic matrices V = {Pi, . . . , Pfc} is a consensus set if and only if every 
product of matrices from V of length 2^" is scrambling. 

This theorem is a stronger version of a result of Wolfowitz fl9J . Arguments based on scrambling have 
often been used in the literature to show that sets of matrices satisfying certain conditions are consensus 
sets [13]. Theorem 12. 21 mav be viewed as a partial converse to some of these results. Since it is easy to check 
whether or not a matrix is scrambling, it also follows from the theorem that consensus is algorithmically 
decidable. 

Corollary 2.3. Given a set of nonnegative, stochastic matrices V — {Pi, . . . ,Pfc} with rational entries 
whose bit-size is at most B, there is an algorithm whichs checks whether V is a consensus set in 

O (^Bkn^ + k^^" n^^ 

The rest of this section will be dedicated to the proof of Theorem 12.21 and Corollary 12.31 
We now give a brief outline of the proof. Our first step in Lemma [231 is to show that 7-" is a consensus set 
if and only if all infinite right-products of matrices from V have row differences which asymptotically vanish. 
In the subsequent Lemma 12.81 we argue that this in turn is equivalent to the property that the supports of 
the rows of any product of matrices from V eventually overlap; moreover, the auxiliary Lemma 12.71 shows 
that if this overlap occurs, it must occur in products of length at most 2^". Putting these pieces together 
leads to the proof of Theorem 12.21 Corollary 12.31 follows as a straightforward consequence after some simple 
manipulations are used to obtain a neater expression for the total number of operations. 



^ We now proceed to the details of the proof. 

Definition 2.4. For a nonnegative stochastic matrix P whose i'th row we will denote by Pi, we define 

6{P) = max ||Pi-Pj||i. 

— l,...,n 

It is not hard to see that for stochastic matrices Pi , P2 , 
(2.1) 6{PiP2) < S{P2). 

Indeed, this follows from the observation that the rows of P1P2 are convex combinations of the rows of P2- 
Our first lemma characterizes consensus sets in terms of the asymptotic properties of the rows of right- 
products of matrices; this is item U] of the lemma. 

Lemma 2.5. The following are equivalent: 

1. V — {Pi, . . . , Pfc} is a consensus set. 

2. For every map T:N^>{l,...,fc}, the limit 

lim P^(t) ■ ■■Pr(2)Pr(i) 

exists and has identical rows. 

3. For every e > there exists an integer t{e) such that if P is the product of t{e) matrices from V , 
then 5{P) < e. 

4-. For all i,j, and all t : N ^ {1, . . . , k}, 

^Ihn (ei - ej)Pr(i)Pr(2)Pr(3) • ■ • -Pr(t) = 0. 

5. For all T : W, ^ {1, . . . , k} and all nonnegative vectors pi, p2 whose entries sum to 1, 

^lim (Pl - P2) Pt(1)Pt (2) Pr (3) ■ ■■Prit) = 0. 

Proof. 

• Equivalence of (1) and (2) is an elementary consequence of the definition of a consensus set. 

• (2) implies (3); Suppose item (3) did not hold. That would mean there exists some e > such that 
for every i = 1, 2, . . . there is a product of i matrices from V whose S is at least e. 

Consider this infinite sequence of products. Observe that there is some ii G such that 

appears infinitely many times as the rightmost matrix in these products; out of the products 
with Pij as the rightmost matrix, there is some 12 £ {1, . . . , fc} such that P^^ appears infinitely as 
the second matrix from the right; and proceeding in this way, we can find 13,^4, . . . and so forth. 
Observe that the infinite product 



has the property that each truncation 



■ P P P 



P^.■■■Pn 



appears as the rightmost part of a product which equals some matrix P with 6{P) > e. But applying 
Eq. (|2.ip . this implies that 

e < 6{P) < 6{P,, ■ ■ ■ P,,) 
for all ik- In turn, this implies that the infinite left-product 

• • • P P P 

^13^ ■12-'- ll 

cannot approach a matrix with identical rows, which contradicts item (2). 



• (3) implies (2); Observe that item (3) implues that the sequence Hi of products !!( = fV(t) ' ' ■^t(i) 
is a Cauchy sequence. Indeed, for any ti,t2 > t{e) the difference between a row of Ht^ and a row of 
11(2 cannot be larger than e in the 1-norm because they are both convex combinations of the rows 
of the matrix Ht(e)- Thus Ht has a Umit. Now applying item (3) we immediately get that this limit 
is a matrix with identical rows. 

• Equivalence of (3) and (4) ; That item (3) implies (4) is trivial; conversely, a sequence of counterex- 
amples to (3) easily yields a sequence of a counterexamples to (4). 

• Equivalence of (4) and (5); Item (4) is a special case of item (5). To argue that item (4) implies 
item (5) observe that every vector whose entries sum to zero can be written as a linear combination 
of the vectors Cj — e^. Thus for any pi,p2 satisfying the conditions of the lemma, there exist a,j 
such that 

Pi - P2 = ^aij{ei - ej), 

i<j 

and so 

lim (pi - P2)Pr(l) • • • Prit) = CLij lim (ei - ej)Pr{i) ■ ■ ■ Pr(t) = 0. 

□ 

Remark 2.6. We wish to remark on the following equivalence which was stated without proof in the 
introduction: {Pi, . . .,Pk} is a consensus set if and only if for every map r : N— >■ {1,. . .,k}, the limit 

lim Pr(t)----Pr(2)-Pr(l) 

exists and has rank one. Indeed, if {Pi, . . . ,Pk} is a consensus set then this statement immediately follows 
from item (2) of the preceeding lemma. Conversely, if limj -Pr(t) ' " ' Pt{i} = for some vectors u,v € R", 
then because the set of stochastic matrices is a closed set which is also closed under multiplication, uv'^ must 
be stochastic as well; this forces u = l which implies item (2) of the preceeding lemma. 

In the next lemma, we take a slight detour to consider matrix products with rows whose supports do 
not overlap. This result will be useful in what follows. 

Lemma 2.7. Suppose that Ai,A2 are nonnegative, nonzero row vectors with disjoint supports and 
Pi,.. . ,Pi is a sequence of matrices from V of length I > 2^" . Moreover, suppose that the supports of 

AiPi ---Pt and A2P1 • • ■ P* 

do not overlap for all t = 1,. . . ,1. Then, there exist nonnegative vectors A'^, Aj with disjoint supports and 
an infinite sequence P{, P2, . . . of matrices from V such that the supports of 

A[PiP^...p; andA'^PiP^-'-Pl 

do not overlap for any t. 

Proof Define be the support of the row vector AiPi ■ ■ ■ Pt, and Sf to be the support of A2P1 ■ ■ ■ Pt 
(for consistency, we will use Sq to mean the support of Ai and Sq to mean the support of A2). By 
assumption, fl = for alH = 0, 1, . . . , I. Note that the pair {Sl,Sf) can take on at most 2^" possible 
distinct values. Since / + 1 > 2^" there exist < is in 0, 1, . . . , Z such that {Sl^,Sf^) = {Slj^,Sf^). 

Next, define 

A'i = AiPi---Pt^, A^ = A2Pi---Pu, 

and let the sequence P{,P2,... to be simply the finite sequence P^^+i, . . . , P^^ repeated infinitely many 
times. By construction, the supports of 



A'lP^P^ • • • P; and A^Pi'P^ • • • P/ 



fio not overlap for i = 0, . . . , — tA, and the suppots of A[ and A']^P{P2 • • • Plj^_fj^ are identical; the same 
holds for the supports of and AjP^Pj ' ' ■ Pta-tA- 

Observe, however, that for a nonnegative stochastic row vector and nonnegative stochastic matrices 
Qi, • ■ • , Qfc, the support of 

v^Qi ---Qk 

depends only on the support of v (and not on the values of its positive entries). We can then therefore 
conclude that the supports of 

AlP^P^ • • • P; and A'lPi'P^ • ■ • P/ 

are identical, and the some conclusion holds with A'j^ replaced with A2. This now implies that for any i, 
the supports of 

A'lP^P^.•P; and A^P^P^-.P; 

do not overlap. □ 

Our next lemma shows the equivalence between a characterization of consensus obtained in Lemma 12.51 
and a scrambling property of matrix products. 

Lemma 2.8. The following are equivalent: 

1. Item of Lemma \2.5\ 

2. For any sequence of matrices Pi, P2, ■■■ from V , and for all nonnegative, nonzero vectors with 
disjoint support, there is some t < 2^" such that the vectors 

APiP2---Pi 

and 

A'PiP2---Pi 

have supports which overlap. 

3. Every product of 2^" matrices from V of length 2^" is scrambling. 
Proof. 

• (1) implies (2): Suppose that (2) is false. By the previous lemma, this means there exists an 
infinite sequence Pi, P2, ■ . and nonnegative, nonzero vectors Ai,A2 such that the supports of 
AiPi ■ • • Pt, A2P1 ■ • • Pf dont overlap for any t. Its clear that this remains true even after we 
normalize the entries of Ai,A2 to sum up to 1. Thus (Ai — A.2)PiP2 ■ ■ ■ Pt is a vector with 
positive entries which add up to 1 and negative entries which add up to —1. This means that 
limt_j.oo(Ai — A2)PiP2 • • • Pt 7^ 0, contradicting item (1). 

• (2) implies (1); Suppose item (2) is true. Given any vectors Pi,P2 which are nonnegative with 
entries summing to 1, define 

pI ^PlPl - Pt, p? =P2Pl - Pt. 

Next, define p™™ to be the nonnegative vector whose z'th entry is the smallest of the i'th entries of 
P(,Pj. Then, we define A^, Aj through the relations 

pJ=pr + Ai, p?=pr" + A2. 

Observe that for any t, A^, A^ are nonnegative, have disjoint support, and their entries must sum 
to the same value, which we will call A(. Moreover, 



(2.2) 



(Pi - P2)Pi • • . P = pj - p? = A] ~ A\. 



We claim that there exists some c > with the following property: for any t there exists a late? 
time t such that 

||p,Vt-P?+dli < (l-c)||pi-p?||i. 
This claim immediately implies that item (1) must be true. 

We now prove the claim. Now for any t, if one of , A^ is the zero vector, then the conclusion 
immediately follows; else, they both must be nonzero (because their entries have the same sum), 
and we may assume without loss of generality that both of them belong to the simplex. Observe 
that for any sequence Pt+i, . . . , Pt^f, 

= frPt+i ■ ■ ■ Pt+i + KPt+i ■ ■ ■ Pt+i, Pii = pf'Pt+i ■ ■ ■ Pt+i + A?Pt+i ■ • • p,+i, 

so that it suffices to show that there is some t and some c > such that for any Pt+i, ■ ■ ■ , Pf+h 
there is some index i so that the i'th entries of AjPt+i ■ ■ ■ P^j^i and ^jPt+i ■ ■ ■ Pf.^f. are both at least 
c. 

Now item (2) says that there exists some t < 2^" such that for any choice of Pt+i, ■ ■ ■ , Pt+i from P, 
the supports of 

Aj Pt+i ■ • ■ P^_^^, Aj Pt+i • ■ • P^^^j^ 

intersect. Because there are only finitely many possible products Pt+i ■ ■ ■ Pt+h it follows that for 
any Aj, Af there exists a c(A( , Af) > such that for any Pt,. . . , P^_^_f there is some index i such 
that both A^^~ and A^^- have z'th entry which is at least c(Aj, A^). Now a compactness argument 
can be used to establish that there exists some c > such that c(Aj, A^) > c for all Aj, Aj in 
the simplex - indeed, if this were not so, then we would be able to find some A], Aj with disjoint 
support in the simplex such that the supports of Aj^- and A'^_^~ do not intersect. 
• (2) and (3) are equivalent: Observe that a nonnegative stochastic matrix Q is scrambling if and only 
if for all efQ and gJQ have supports which intersect, or, equivalently, if for all nonnegative, 
nonzero vectors vi,V2, the vectors vfQ and w^Q have supports which intersect. 

□ 

Proof of Theorem \2.2[ Putting Lemmas 12.51 and 12.81 together, we see that the first item of the former is 
equivalent to the last item of the latter. This is exactly the statement of the theorem. □ 

Proof of Corollary \2.3\ To check whether a set of matrices is a consensus set, we check whether all 
products of length 2^" are scrambling and output "yes" if they are and "no" if they are not; by Theorem 
12.21 this produces the correct answer. We next argue that this may be completed in 0{Bkn^ + fc^ n^) 
operations. 

We first observe that to check whether a given matrix is scrambling, we do not need to know its entries 
exactly; we only need to know whether they are positive. To make use of this observation, we will go 
through all the entries of the matrices Pi , . . . , P^ and replace each positive number by the symbol 1 and each 
zero by the symbol 0. In algebraic manipulation of these symbols we apply the usual rules with the added 
convention that 1 + 1 = 1. Its easy to see that a product of matrices is scrambling if and only if the product 
of the matrices with symbolic entries as above has rows with overlapping supports. Note that producing the 
matrices with symbolic entries takes 0{Bkn^) operations; we next turn to the complexity of checking that 
all products of length 2^" of these matrices have supports which overlap. 

To compute all products of length Z, we first compute all products of size 1/2, and then multiply all 
possible pairs from the latter; this takes 0{k''n^) operations. Thus to compute all products of length 2^" 
takes 

0{k^'"n^) + 0{k^^"'\^) + ■ • • = 0{k^^"n^). 

Finally, to check that each of the resulting matrices has rows with overlapping supports takes 0{k^^"n^) 
operations. Thus the final count is 0{Bkn^ + k^ nP). □ 



" 3. Complexity of the consensus problem. In this section, we show that unless P = NP there does 
not exist a polynomial-time algorithm for the consensus problem even in the case of two matrices. We prove 
a similar result for three undirected matrices. We begin by stating our main results. 

Theorem 3.1. Unless P — NP, the problem of determining if a given set of two stochastic matrices is 
a consensus set cannot be decided in polynomial-time. 

Theorem 3.2. Unless P = NP, the problem of determining if a given set of three undirected stochastic 
matrices is a consensus set cannot be decided in polynomial-time. 

The assumptions of Theorem 13 . 2 1 cannot be relaxed from requiring each of the matrices to be undirected 
to requiring the matrices to be symmetric. In fact, one can check whether a set of stochastic and symmetric 
matrices {Ai, . . . ,Ak} is a consensus set in polynomial time. Indeed, defining G{A) to be the (undirected) 
graph with edges {i,j) whenever Uij > 0, it is not hard to see that {Ai, . . . , A^} is a consensus set if and 
only if each of the graphs G{Ai), . . . , G{Ak) is connected and non-bipartite. 

The remainder of this section will be devoted to the proof of these theorems, which we now briefly 
outline. 

Our strategy will be to show both consensus and the non-satisfiability of a 3-SAT problem are equivalent 
to the non-existence of a path between two nodes in every possible sequence of two particularly chosen graphs 
Gi, G2 (our notion of a path in a graph sequence is the straightforward one; the interested reader may refer 
to Definition 13.41 below for a precise statement). One side of this equivalence is easy: the equivalence of 
consensus and the non-existence of a path is easily obtained by taking scalings of the adjacency matrices 
of the graphs and applying the results of the previous section on supports which eventually overlap. On 
the other hand, to show that the insatisfiability of 3-SAT and the non-existence of a path are equivalent we 
use a variation of a previous construction from |15] . Finally, to prove the result for undirected matrices we 
will construct a gadget for simulating directed paths on sequences of two graphs with undirected paths on 
sequences of three graphs. 

We next proceed to the details of the proofs. 

Definition 3.3. Given a 3-SAT formula f, we will define two graphs Go(/),Gi(/) as follows (the 
reader may wish to refer to Figure CO] for an example). 

We will create a node for each clause/variable pair; the node corresponding to clause i and variable j 
will be called Cij. There will be a node F (intuitively thought of as a "failure node") and nodes S2, ■ . ■ , Sn+i 
(intuitively thought of as "intermediate .success nodes."). 

For convience, we will also adopt the following notation. For any i, G^.n+i will refer to the node F. 
Moreover, Sn+i will sometimes be labeled simply as S . 

If setting variable i to satisfies clause j, then we will put a directed link from Cij to Si+i in Go(/); 
else, we will put a directed link from Gtj to d.j+i in Go{f) (note that when j — n, this link leads to F). 

If setting variable i to 1 satisfies clause j, then we will put a directed link from d.j to Si+i in Gi(/); 
else, we will put a directed link from Gij to Cij+i in Gi(/) (note that when j = n this link leads to F). 

Finally, both Gi, G2 will have self-loops at F , links from each Si to Si+i and links from S = Sn+i to all 
Gi,i. 

Definition 3.4. Consider a sequence of directed graphs Gi,G2,G3, ...on the same vertex set V. We 
will say that et-^^, . ■ . ,et^ is a path from node u to node v if: (i) et^ is an edge in Gt^ (ii) the source of 
ei is u and the destination of Cf^ is v (Hi) the source of Cf. is the same as the destination of ef._j for 
z = ii + 1, . . . ,^2- 

Lemma 3.5. A SAT formula f is satisfiable if and only there exists a sequence 0/ Go(/), Gi(/) of 
length at least n -\- 1 without a path from S to F. 

Proof. Suppose that the 3-SAT problem is satisfiable, i.e., there exists an assignment of {0,1} to the 
variables satisfying every clause. We need to find a sequence of the graphs Go(/),Gi(/) of length n + 1 
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Fig. 3.1: The graphs corresponding to the formula {xi V 0:2 V xa) A (xT V aJi V a^). Edges which are present 
in both Go{f), Gi{f) are shown in brown; edges which are only in Go(/) are shown in blue and edges which 
are only in Gi(/) are in red. 



without a path from S to F. Because the links going out of node S are the same in both Go(/) and Gi{f) 
(they lead to all of the nodes Ci^i), equivalently we need to find a sequence of the graphs Go(/),Gi(/) of 
length n such that there is no path from any d^i to F. 

We will construct such a sequence as follows: we will set the i'th graph to be Go(/) if the «'th variable 
in the satisfying assignment is and Gi(/) if the i'th variable in the satisfying assignment is 1. 

We argue there is no path from any G^.i to F in this sequence. Indeed, the links from any G^j either 
lead "to the right" to Cij+i or "down" to Sj+i. Because there is no path of length n or less from any 5^- 
to F, it suffices to argue that at some time step, only the "down" edge to some S^+i will be available. But 
clause i is satisfied by at least one variable, say by variable k; and so by construction the only edge from 
Ci^k at time k will lead to 5*^+1. Thus there is no path from Ci^i to Ci^k+i of length fc, which means that 
every path beginning at Gi^i of length k arrives at Sk+i- This proves the "only if" part. 

To prove the "if" part, assume that there is a sequence of length n + 1 with no path from S to F; as we 
remarked above, this is equivalent to the assumption that there a sequence of length n with no path from 
all the Gi,i to F. Let Xi be if the i'th element of the sequence is Go(/) and 1 if the i'th element of the 
sequence is Gi(/). We argue that this is a satisfying assignment. 

Indeed, consider some clause i. We know that there is no path of length n from Gi,i to F. Note that 
if at every time step k there was a link from Ci^k to Ci^k+i then a path from Ci^i to F would exist. Thus 
there is some time step k at which there is only a link from Ci^k to Sk+i- By construction of the graphs 
Go(/),Gi(/), this means that our assignment satisfies clause i via variable x^. □ 

Definition 3.6. Define do{f,i) to mean the out-degree of node i in Go(/); c?i(/, i) is defined similarly. 
We will define the matrix ^o(/) [^o(/)]ii = ^/doif^i) if (i,j) is an edge in Go(/) and otherwise; the 
matrix Ai{f) is defined similarly. Note that Ao(/) and Ai(f) are nonnegative stochastic matrices. 

Lemma 3.7. {Ao(/), is a consensus set if and only if every sequence of graphs Go(/),Gi(/) of 

length n + 1 has a path from S to F. 

Proof. By item [3] of Lemma 12.81 {Ao{f), Ai{f)} is a consensus set if and only if every product of 
Ao{f), Ai{f) of length 2^" is scrambling. Note, however, that the support of row i of any such product is 
exactly the set of nodes reachable from node i via a path in the corresponding sequence of graphs. Thus 
{Ao{f),Ai{f)} is a consensus set if and only if for every sequence of Go(/),Gi(/) of length 2^" and every 
pair of indices i, j, there is a third index k reachable from both i and j through a path in that graph sequence. 



^ This, however, is equivalent to the assertion that every graph sequence of length n + 1 has a path from 
S to F. Indeed, if every graph sequence of length n + 1 had such a path, then from every node k (and for 
every infinite graph sequence) there is a path from A: to of length 2{n + 1) (by going from k to one of 
{S, F} in at most n+1 steps and then either taking the selp-loop at F or going from to F in n + 1 more). 
This means that there is a path from fc to F of any length larger than 2{n + 1) by taking the self-loop at F, 
and in particular of length 2^". 

Conversely, if there is a sequence of length n+1 with no path from S to F, then by concatenating it 
with itself we would obtain an infinite graph sequence with the property that the set of nodes reachable 
from F (which is just F) and the set of nodes reachable from S never intersect. In particular, they do not 
intersect in the first 2^" steps. □ 

Remark 3.8. We may restate Lemma \3.7\ as follows: {Ao(/), Ai(/)} is a consensus set if and only if 
there does not exist an infinite sequence of graphs Go{f)^Gi{f) without a path from S to F. The proof of 
Lemma \3. 7| proves the equivalence of these two formulations as a byproduct. 

Proof of Theorem \3.1\ By putting together Lemma l3.5l and Lemma l3.7l we observe that, starting from an 
instance of 3-SAT with variables xi, . . . , a;„ and m clauses, we can construct in polynomial time nonnegative, 
stochastic matrices Pi, P2 e m(™+i)"+ix(™+i)"++i such that the 3-SAT instance is unsatisfiable if and only 
if {Pi, P2} is a consensus set. The theorem immediately follows. 
□ 

Remark 3.9. Observe that for any formula f , an infinite left-product of of the matrices {Ao(/), Ai(/)} 
either does not converge to a rank-1 matrix or converges to the matrix epl'^ . It may be argued that this 
represents a "pathological" case of convergence to consensus as in many applications it is desired that the 
final matrix equal vl^ where v is a strictly positive vector; intuitively, one wants every node to "contribute" 
to the final result. 

We give a brief informal sketch here of a construction that remedies this issue. We will create two new 
matrices ^o(/), j4i(/) with the property that they form a consensus set if and only if old Ao{f), Ai(f) formed 
a consensus set; however, any convergent infinite left-product of the new matrices must converge to a strictly 
positive matrix (which, consequently, can only be written as vl'^ with strictly positive v). These matrices are 
constructed exactly as before in Definition \3.6\ from, however, new graphs Go(/),Gi(/) defined as follows. 
The new Ga{f) is obtained by taking two copies of the old Go{f), adding links going from each of the F 
nodes to all the nodes in its copy, and adding links going both ways between the two F nodes. The new Gi{f) 
is produced in the same way. We recommend the reader consult Figure [37^ for an illustration. 

Observe that if the old {Ao(/), Ai(f)} was not a consensus set, the new matrices do not form a consensus 
set either. Indeed, by Remark \3. 8\ the old set was a consensus set if and only if there existed a sequence of 
the old G'o(/),Gi(/) such that starting from S one never reached F; this implies that in the same sequence 
of the new Go(/), Gi{f), paths starting from the two S nodes never reach their corresponding F nodes and 
so never intersect. This implies the new matrices Agi^f), Ai(f) do not form a consensus set. 

Conversely, if the old {A^^f), Ai{f)} was a consensus set, the new matrices form a consensus set as well. 
By Lemma \3.7\ we know that that the old matrices formed a consensus set if and only if in any sequence of 
graphs there is a path of length 2(n -|- 1) from each node to node F (by going first to one of {S, F} in at most 
n + 1 steps and then either taking the self-loop at F n + 1 times or going from S to F). It immediately follows 
that in any sequence of the new graphs, there is a path from any node to any other node of length 2 (n -I- 1) -1-2. 
By Lemma \2.8\. this implies that {Ao(/), Ai(/)} is a consensus set; moreover, it implies that any product of 
the matrices Ao{f),Ai{f) of length 2(n + l) + 2 has entries bounded below by (l/(2(m + l)(n + l)))2("+i)+2^ 
which menas that any limiting matrix of an infinite left-product must be positive. 

Proof of Theorem \3.2[ Given a 3-SAT formula/, we will construct three undirected matrices Bo{f),Bi{f), P2(/) £ 
]j^4(m+i)n+4x4(m+i)n+4^ p^^^g ^^^^^ {Pq (/) , (/) , P2 (/) } IS a couseusus Set if and only if 

{Ao(/), Ai(/)} is a consensus set. Together with Theorem 13. II this proves the current theorem. 

We will construct these matrices as in Definition 13.61 from undirected graphs 5o(/), 5i(/), 52(/) defined 
next. Note that the undirectedness of the graphs will imply the undirectedness of the corresponding matrices. 
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Fig. 3.2: The graphs corresponding to the formula (xi V 0:2 V 2:3) A {'xi V 3^ V S3). Edges which are present 
in both Go{f), Gi{f) are shown in brown; edges which are only in Go{f) are shown in blue and edges which 
are only in Gi(/) are in red. 




Fig. 3.3: The graphs corresponding to the formula {xi V 12 V 0:3) A (xT V 12 V X3). The common edges of 
so(/),si(/) are in brown; the edges which are only in so(/) are in blue, while the edges which are only in 
si(/) are in red. The graph S2(/) is given in green. 



We will first construct undirected graphs so(/), si(/), S2(/) by taking every node of Go{f), Gi{f) (recall 
that these graphs share a common set of nodes) except F and spliting them into two nodes - a "top" node 
and "bottom" node. We will use the subscripts T, B to refer to the new nodes, e.g., node F splits into a 
top node and a bottom node a^. For convenience of notation, both F^ and Fq will refer to the (single) 
node F. We will put edges in the new (undirected) graphs So{f), Si(/) based on old edges in the (directed) 
graphs Go(/),Gi(/) as follows: if {k,l) was an edge in Gi{f) then we will put the edge {kT,lB) in Si(/)- 
The graph S3(/) will contain all edges from the top node of a split pair to the bottom node of the same split 
pair (which we will understand to include a self-loop at node F) . We refer the reader to Figure 13.31 for a 
concrete example of these graphs. 

We construct go{f), 9i{f) as follows. We take so(/), si(/) and add edges from every bottom node to F; 
then we take two copies of the resulting graph and connect their F nodes. The graph gaif) is constructed 
in the same way, except that the new edges in each copy go from every top node to F instead. 

Our construction has the following property: if there is a path from node a to node b in some sequence of 
Go(/), Gi{f) (say in the sequence Go(/)Go(/)Gi(/)Go(/)) then in each of the two copies, there is a path from 
qt to br in the graph sequence obtained by replacing Go(/) by go{f), Gi(/) by gi{f), and inserting 52(/) into 
every even time step (for the above sequence this translates to ffo(/)52(/)5o(/)32(/)5i(/)52(/)fl'o(/)52(/))- 
Thus paths in graph sequences of Go(/), Gi(/) can be "ported" into sequences of the graphs go(/)i 5'i(/)i 52(/) 
wherein g2{f) appears at, and only at, the even time steps. We will make use of this property below. 

We now proceed to the proof of the current theorem. Suppose {Ao(/), Ai{f)} is not a consensus set. By 
Remark l3.81 this means that there exists an infinite sequence of Go(/), Gi(/) such that there is no path from 
S to F. Consider replacing every Go(/) by go{f), every Gi(/) by gi{f) and inserting 52(/) into every even 
time slot. By construction, we have that paths beginning at the two St nodes never reach the F nodes in 
their halves of the graph. Since the only edges connecting the two halves of the graphs connect the i^-nodes, 
we have that the set of reachable nodes from the two S nodes never intersect. By item |4] of Lemma [2751 this 
implies {i3o(/), Bi(/), S2(/)} is not a consensus set. 

Conversely, suppose that {Ao{f), Ai{f)} is a consensus set. We next show that for every pair of nodes 
i,j and every sequence of 5o(/)7 5i(/)j 52(/) of length 4(n + 1) + 3, there is some third node k reachable by 
a path starting from both i and j. 

Indeed: our assumption that {Ao{f), Ai{f)} is a consensus set along with Lemma [3.71 assures us that 
every sequence of Gi(/), G2(/) has a path from 5 to of length at most n + 1. Now consider any sequence 
of go{f) I gi{f) I g^if) ■ These sequences will either have or not have the property that g2{f) appears at, and 
only at, the even time steps. 

If the sequence does have this property, then there is a path from any node to the F node in its copy 
in 4(n + 1) steps (indeed, at most 2(n + 1) steps to reach either F or the 5*7- in its copy, and then 2{n + 1) 
additional steps to go from St to F and necessary, and take self- loops at F the remainder of the time). Thus 
the sets of reachable nodes starting at any disjoint pair of vertices intersect after 4(n -I- 1) -f 1 steps. 

If not, then either g2{f) appears at an odd time step or one of go(/),5i(/) appears at an even time step. 
It is not hard to prove by induction that there is a path from any node to the i<"-node of its copy the first 
time this happens, and naturally at the following time step the sets of nodes reachable from any two distinct 
vertices must intersect. 

Putting these two facts together, we complete the proof of the assertion that for all sequences of 
5o(/), 5i(/), 52(7), there is a common reachable node from any pair of vertices in at most 4(n -I- 1) + 3 
steps. But now this implies that every matrix product of i3o(/), Bi{f) of length A{n + 1) + 3 is scrambling 
and Lemma [2.81 implies that {i?o(/), Si(/), i?2(/)} is a consensus set. □ 

4. Conclusions. Our goal has been to investigate the complexity of the consensus problem, and we 
have obtained some partial results to that end. We have shown that the consensus problem is decidable but 
that it is NP-hard for two matrices and for three undirected matrices. 

Our work points to some intriguing open questions. We have left open the complexity of deciding 
whether a set of two undirected matrices is a consensus set. Moreover, our algorithm for deciding whether 
a set of matrices is a consensus set is doubly-exponential in the matrix dimension n, and it is interesting to 
ask whether a singly-exponential algorithm exists. 

More broadly, even though stability determination for switched systems often turns out to be undecidable 



[2] , it may turn out to be decidable (and even tractable) for many important subclasses of switched systernS? 
It would be very interesting to relate the complexity of stability questions such as the one we consider here 
to the structural properties of the systems. 



REFERENCES 

[1] D. Angcli, P.-A. Bliman, Stability of leaderless discrete-time multi-agent systems, Mathematics of Control, Signals, and 

Systems, 18 (2006), pp. 293-322. 
[2] V. D. Blondel and J. N. Tsitsiklis, The boundedness of all products of a pair of matrices is undecidable, Systems and 

Control Letters, 41 (2000) PP. pp. 135-140. 
[3] H.-L. Choi, L. Brunet, J. P. How, Consensus-based decentralized auctions for task assignment, IEEE Transactions on 

Robotics, (25) 2009. 

[4] C. Gao, J. Cortes, F. BuIIo, Notes on averaging over acyclic digraphs and discrete coverage control, Automatica 44 (2008), 
pp. 2120-2127. 

[5] A. Jadbabaie, J. Lin, and A. S. Morse, Coordination of groups of mobile autonomous agents using nearest neighbor rules, 

IEEE Transactions on Automatic Control, 48 (2003) pp. 988-1001. 
[6] Z. Lin, B. Francis, M. Maggiore, State agreement for continuous time coupled nonlinear systems, SIAM Journal on Control 

and Optimization, 46 (2007), pp. 288-307. 
[7] J. Lorcnz, D.A. Lorenz, On Conditions for Convergence to Consensus, IEEE Transactions on Automatic Control, 55 

(2010), pp. 1651-1656. 

[8] L. Moreau, Stability of multi-agent systems with time- dependent communication links, IEEE Transactions on Automatic 

Control, (50) 2005, pp. 169-182. 
[9] A. Nedic, A. Ozdaglar, Distributed subgradient methods for multi-agent optimization, IEEE Transactions on Automatic 

Control, 54 (2009) pp. 48-61. 

[10] A. Nedic, A. Olshevsky, A. Ozdaglar, J. N. Tsitsiklis, On distributed averaging algorithms and quantization effects, IEEE 

Transactions on Automatic Control, 54 (2009) pp. 2506-2517. 
[11] R. Olfati-Saber, J. A. Fax, R. M. Murray, Consensus and cooperation in networked multi-agent systems. Proceedings of 

the IEEE, 95 (2007) pp. 215-233. 
[12] A. Olshevsky, Efficient information aggregation strategies for distributed control and signal processing, Ph.D. thesis. 

Department of Electrical Engineering and Computer Science, MIT, 2010. 
[13] E. Seneta, Non-negative Matices and Markov Chains, Allen & Unwin Ltd., London, 1973 

[14] J. N. Tsitsiklis, D. P. Bertsekas, and M. Athans, Distributed asynchronous deterministic and stochastic gradient opti- 
mization algorithms, IEEE Transactions on Automatic Control, 31 (1986) pp. pp. 803-812. 

[15] J. N. Tsitsiklis and V. D. Blondel, The Lyapunov exponent and joint spectral radius of pairs of matrices are hard - when 
not impossible - to compute and to approximate. Mathematics of Control, Signals and Systems, 10 (1997), pp. 31-40. 

[16] F. Xiao, L. Wang, Asynchronous consensus in continuous-time multi-agent systems with switching topology and time- 
varying delays, IEEE Transactions on Automatic Control, 53 (2008) pp. 1804-1816. 

[17] L. Xiao, S. Boyd, S. Lall, A Scheme for Robust Distributed Sensor Fusion Based on Average Consensus, Proceedings of 
International Conference on Information Processing in Sensor Networks, 2005. 

[18] L. Xiao, S. Boyd, S. Lall, A Space-Time Diffusion Scheme for Peer-to-Peer Least-Squares Estimation, Proceedings of 
Fifth International Conference on Information Processing in Sensor Networks, Nashville, TN, 2006. 

[19] J. Wolfowitz, Products of Indecomposable, Aperiodic, Stochastic Matrices, Proceedings of the American Mathematical 
Society, 14 (1963), pp. 733-737. 



